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(54) IMAGING APPARATUS AND IMAGE PICKUP METHOD 

(57)Abstract: 

PROBLEM TO BE SOLVED: To provide an imaging apparatus and an 
imaging method that prevent production of an improper finally generated 
image on the occurrence of a fault disturbing multiple image processing in a 
multiple photographing image mode and to provide the image pickup device 
that can inform a photographer about the occurrence of a fault. 
SOLUTION: The imaging apparatus has the multiple photographing image 
mode where a plurality of photographing image are synthesized to obtain a 
single image as a multiple image processing. A fault disturbing the multiple 
image processing is detected during the photographing in the multiple 
photographing image mode. When any fault is detected, the processing in 
the multiple photographing image mode is stopped. Thus, a defect that the 
processing in the multiple photographing image mode is automatically 
continued and a defective photographing image corresponding to the fault 
is automatically integrated as a multiple image processing object can be 
avoided. 
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* NOTICES * 




Japan Patent Office is not responsible for any 
damages caused by the use of this translation. 

1 .This document has been translated by computer. So the translation may not reflect the original precisely. 
2.**** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] It is image pick-up equipment characterized by to have the control means which stops processing by 
multiplex image photography mode when abnormalities are detected by a malfunction-detection means detect the 
abnormalities which bar said multiplex image processing during photography with said multiplex image photography 
mode in the image pick-up equipment which has the multiplex image photography mode for performing the multiplex 
image processing which compounds the photography image of two or more sheets, and obtains a single image, and said 
malfunction-detection means. 

[Claim 2] It is image pick-up equipment characterized by to have the control means which stops processing by 
multiplex image photography mode when abnormalities are detected by a malfunction-detection means detect the 
abnormalities which bar said multiplex image processing to the image which photoed in said multiplex image 
photography mode in the image pick-up equipment which has the multiplex image photography mode for performing 
the multiplex image processing which compounds the photography image of two or more sheets, and obtains a single 
image, and said malfimction-detection means. 

[Claim 3] It is image pick-up equipment characterized by to have a display means display the purport that multiplex 
photography went wrong when abnormalities are detected by a malfunction-detection means detect the abnormalities 
which bar said multiplex image processing during photography with said multiplex image photography mode in the 
image pick-up equipment which has the multiplex image photography mode for performing the multiplex image 
processing which compounds the photography image of two or more sheets, and obtains a single image, and said 
malfunction-detection means. 

[Claim 4] It is image pick-up equipment characterized by to have a display means display the purport that multiplex 
photography went wrong when abnormalities are detected by a malfunction-detection means detect the abnormalities 
which bar said multiplex image processing to the image which photoed in said multiplex image photography mode in 
the image pick-up equipment which has the multiplex image photography mode for performing the multiplex image 
processing which compounds the photography image of two or more sheets, and obtains a single image, and said 
malfunction-detection means. 

[Claim 5] It is the image pick-up approach characterized by having the step which stops processing by multiplex image 
photography mode when abnormalities are detected, the step which detects the abnormalities which bar said multiplex 
image processing during the multiplex image photography for performing the multiplex image processing which 
compounds the photography image of two or more sheets, and obtains a single image, and. 

[Claim 6] It is the image pick-up approach characterized by having the step which stops processing by multiplex image 
photography mode when the step which detects the abnormalities which bar said multiplex image processing, and 
abnormalities are detected to the image obtained by the multiplex image photography for performing the multiplex 
image processing which compounds the photography image of two or more sheets, and obtains a single image. 



[Translation done.] 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the image pick-up equipment and the image pick-up approach which 

are applied to a digital camera etc. 

[0002] 

[Description of the Prior Art] What can photo the mode which is called the multiplex image photography mode for 
multiplex photography processing as the former, for example, a digital camera, is known. 

[0003] Such a multiplex image processing For example, the high resolving processing which creates a high resolution 
image from two or more images, It creates, and it blurs and the image which compounds the depth control processing 
which compounds the image which adjusted the depth of field from two or more images, the large gradation processing 
which opens the dynamic range of an image pick-up, or two or more images, and does not have blurring is stopped. Like 
processing It is the processing which compounds two or more images which changed image pick-up conditions and 
photoed the same photographic subject, and obtains a single image, and it is carried out inside a digital camera or is 
carried out using a personal computer etc. Moreover, multiplex image photography mode is the mode in which the 
image of two or more sheets for said multiplex image processing is obtained. 

[0004] It is a premise for a camera station to be in abbreviation etc. by carrying out, and to picturize the same 
photographic subject, and, for this reason, acquisition of two or more images twisted in the above-mentioned multiplex 
image photography mode picturizes the photographic subject of the above-mentioned identitas continuously in 
multiplex image photography mode. Specifically, the seriography of two or more images will be carried out to one 
image pick-up directions by the photography person. 
[0005] 

[Problem(s) to be Solved by the Invention] By the way, a photography person may photo a photographic subject, 
without sometimes checking the mode of the present **. For example, when image pick-up directions are performed 
having mistaken that it is in single image photography mode for the mode in which a photography person is current 
being multiplex image photography mode, a digital camera may sometimes be moved [ enough ] during photography. 
However, if a digital camera is moved during photography of a multiplex image, the image with which the camera 
station shifted greatly will be used for a multiplex image processing, and the good last generation image cannot be 
obtained. Moreover, when the shelter has jumped in suddenly in front of a digital camera during two or more images 
photography, the image with which the shelter was reflected will be used for a multiplex image processing, and the too 
good last generation image cannot be obtained. 

[0006] Moreover, in the multiplex image-processing phase after photography, by the degree of an extraneous light etc., 
the light exposure of some images may be insufficient among picturized two or more images, and black crushing may 
occur. On the contrary, the light beyond anticipation is irradiated by the photographic subject and a white jump etc. may 
occur. If the image of such black crushing and the image of a white jump are used for a multiplex image processing, 
since the appearance of the last generation image worsens, it will not be fit for a multiplex image processing under the 
effect of the defect image. 

[0007] This invention makes it a technical problem to offer the image pick-up equipment which can tell a photography 
person about having been made in view of the above-mentioned actual condition, and having offered the image pick-up 
equipment which can prevent generating of the unsuitable last generation image when the abnormalities which bar a 
multiplex image processing arise in multiplex photography image mode, and the image pick-up approach, or 
abnormalities having arisen. 
[0008] 
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[Means for Solving the Problem] In ^^fcnage pick-up equipment which has the tn^Mex image photography mode for 
performing the multiplex image procwKg which the above-mentioned technical p^lem compounds the photography 
image of two or more sheets, and obtains a single image When abnormalities are detected by a malfunction detection 
means to detect the abnormalities which bar said multiplex image processing during photography with said multiplex 
image photography mode, and the malfunction detection means, it is solved by the image pick-up equipment 
characterized by having the control means which suspends processing by multiplex image photography mode. 
[0009] When abnormalities are detected during photography, and a shelter crosses a taking-lens front or further [ that 
blurring at the time of photography and poor exposure occur with this image pick-up equipment ] Since processing by 
multiplex image photography mode is suspended when it becomes a power-source piece etc. Processing by multiplex 
image photography mode is continued automatically, the inconvenience into which the defect image pick-up image 
corresponding to these abnormalities is automatically built as a multiplex image-processing object is lost, and 
generating of the unsuitable last generation image is prevented beforehand. 

[0010] Moreover, it sets to the image pick-up equipment which has the multiplex image photography mode for 
performing the multiplex image processing which said technical problem compounds the photography image of two or 
more sheets, and obtains a single image. When abnormalities are detected by a malfunction detection means to detect 
the abnormalities which bar said multiplex image processing, and the malfunction detection means, to the image 
photoed in said multiplex image photography mode It is solved also by the image pick-up equipment characterized by 
having the control means which suspends processing by multiplex image photography mode. 
[001 1] With this image pick-up equipment, if there are abnormalities of an image, for example, the image of black 
crushing and the image of a white jump, since processing by multiplex image photography mode is suspended, the 
inconvenience into which the image of said black crushing and the image of a white jump are automatically built as a 
multiplex image-processing object will be lost, and generating of the unsuitable last generation image will be prevented 
beforehand. 

[0012] Moreover, it sets to the image pick-up equipment which has the multiplex image photography mode for 
performing the multiplex image processing which said technical problem compounds the photography image of two or 
more sheets, and obtains a single image. When abnormalities are detected by a malfunction detection means to detect 
the abnormalities which bar said multiplex image processing during photography with said multiplex image 
photography mode, and the malfunction detection means, it is solved also by the image pick-up equipment characterized 
by having a display means to display the purport that multiplex image photography went wrong. 
[0013] With this image pick-up equipment, a photography person can recognize with a display means that multiplex 
image photography went wrong. 

[0014] Moreover, it sets to the image pick-up equipment which has the multiplex image photography mode for 
performing the multiplex image processing which said technical problem compounds the photography image of two or 
more sheets, and obtains a single image. When abnormalities are detected by a malfunction detection means to detect 
the abnormalities which bar said multiplex image processing, and the malfunction detection means, to the image 
photoed in said multiplex image photography mode It is solved also by the image pick-up equipment characterized by 
having a display means to display the purport that multiplex image photography went wrong. 

[0015] A photography person can recognize with a display means that abnormalities arose also with this image pick-up 
equipment. 

[0016] Moreover, the step which detects the abnormalities which bar said multiplex image processing during the 
multiplex image photography for performing the multiplex image processing which said technical problem compounds 
the photography image of two or more sheets, and obtains a single image, The step which suspends processing by 
multiplex image-processing mode when abnormalities are detected, The step which detects the abnormalities which bar 
said multiplex image processing to the image obtained by the multiplex image photography for performing the image 
pick-up approach characterized by preparation ******, and the multiplex image processing which compounds the 
photography image of two or more sheets, and obtains a single image, When abnormalities are detected, it is solved also 
by the image pick-up approach characterized by having the step which suspends processing by multiplex image- 
processing mode. 

[0017] According to these image pick-up approaches, when abnormalities are detected during photography, or when 
abnormalities are detected by the obtained image, since processing by multiplex image-processing mode is suspended, it 
is lost that the defect image pick-up image corresponding to these abnormalities is automatically incorporated as a 
multiplex image-processing object, and generating of the unsuitable last generation image is prevented beforehand. 
[0018] 

[Embodiment of the Invention] Hereafter, 1 operation gestalt of this invention is explained based on a drawing. 
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[0019] Drawing 1 - drawing! show ^^fcgital camera as image pick-up equipmen^^cerning 1 operation gestalt of 
this invention. In addition, with this qKition gestalt, the external instrument, for e^Hmple, a personal computer, shall 
perform the multiplex image processing. 

[0020] In drawing 1 - drawing.3 , the digital camera 1 consists of the body section 2 of a camera of a core box, and the 
rectangular parallelepiped-like image pick-up section 3. The image pick-up section 3 is seen from a transverse plane 
(space near side of drawing 1 ), and the right lateral of the body section 2 of a camera is equipped with it rotatable in 
removable, and this right lateral and an parallel field. 

[0021] Said image pick-up section 3 has image pick-up equipment which consists of an optoelectric transducer of CCD 
(Charge Coupled Device) 303 grade indicated to be the talcing lens 301 which consists of a macro zoom to drawing 4 , 
and the optical image of a photographic subject is changed into the image constituted by the charge signal by which 
photo electric translation was carried out by each pixel of CCD303, and it incorporates it. 

[0022] On the other hand, the body section 2 of a camera has the connection terminal 13 with which external connection 
of a display 10, the applied part 17 of the memory card 8 as an example of an archive medium, a personal computer, etc. 
which consist of LCD (Liquid Crystal Display) is made. After performing predetermined signal processing to the picture 
signal incorporated mainly in the above-mentioned image pick-up section 3, the transfer to the network connection 
devices ( drawin g 4 ) 19, such as a display to the LCD display 10, record to a memory card 8, and a personal computer, 
etc. is processed. 

[0023] A taking lens 301 is arranged in the interior of the image pick-up section 3, and the image pick-up circuit section 
which equipped the proper place of the back location of this taking lens 301 with the CCD color area sensor 303 
( drawing 4 ) is prepared in it. Moreover, the modulated light circuit 304 ( drawing 4 ) equipped with the modulated 
light sensor 305 which receives the reflected light from the photographic subject of flash plate light is established in the 
proper place in the image pick-up section 3. 

[0024] The amount of incident light to a taking lens 301 is detected, and the modulated light sensor 305 can detecfthat 
the person etc. crossed the taking-lens 301 front. 

[0025] Furthermore, the white balance (WB) sensor 21, the ranging sensor (not shown), etc. are prepared for the proper 
place in the image pick-up section 3. The WB sensor 21 is for detecting the color temperature of light and adjusting the 
white balance of an image. Moreover, a ranging sensor measures the distance to a photographic subject as an object for 
auto focuses (AF). 

[0026] As shown in the front face of the body section 2 of a camera at drawing 1 , the grip section 4 is prepared for the 
proper place of the left end section, and the built-in flash plate 5 is prepared for the up proper place of a right edge. 
Moreover, as shown in drawing 1 , the switches 6 and 7 for coma delivery at the time of reproducing a record image are 
formed in the center of abbreviation on the top face of the body section 2 of a camera. A switch 6 is for carrying out 
coma delivery of the record image in the direction (the direction of the order of photography) in which a coma number 
increases (henceforth the Up key), and a switch 7 is for carrying out coma delivery of the record image in the direction 
in which a coma number decreases (henceforth the Down key). Moreover, the elimination switch D for eliminating the 
image which saw from the tooth-back side (space near side of drawin g 2 ), and was recorded on the memory card 8 on 
the left-hand side of the Down key 7 is formed, and the shutter release 9 is formed in the right-hand side of the Up key 
6. 

[0027] In the tooth back of the body section 2 of a camera, as shown in drawing 2 , the LCD display 10 for performing 
the monitor display (equivalent to a view finder) of a photography image, the repeat display of a record image, etc. is 
formed in the center of abbreviation of the left end section. Moreover, as shown in drawin g 7 , it sets in multiplex image 
photography mode, and the display 431 which warns of it and displays generating of inconvenient abnormalities, and 
the display 432 which indicates that it is photography by multiplex image mode are formed in the lower field in the 
LCD display 10 at the multiplex image processing, and when a photography person checks the image VD of a 
photographic subject by looking, it has come to be able to make the check of these displays 43 1,432 easy. Moreover, the 
compressibility setting-out slide switch 12 for carrying out change-over setting out of the compressibility K of the image 
data recorded on a memory card 8 is formed in the lower part location of the above-mentioned LCD display 10, and 
electric power switch PS is further prepared in the tooth-back upper part. Moreover, the above-mentioned connection 
terminal 13 is formed in the side face by the side of the image pick-up section 3 of the body section 2 of a camera. 
[0028] Furthermore, the microphone combination loudspeaker Media Interface Connector for recording voice or 
generating the recorded voice at the time of playback is formed in the body section 2 of a camera, and in case a video 
signal is displayed, the sound signal included in a video signal can be heard through Microphone Media Interface 
Connector. 

[0029] In said digital camera 1, as the mode about flash plate (FURAYUSHU may be hereafter described as floor line) 
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luminescence The "automatic lumine^^ce mode" in which the built-in flash plat^fc made to emit light automatically 
according to photographic subject br^Kess, The "luminescence prohibition mod^^ which luminescence of "the 
compulsive luminescence mode" in which the built-in flash plate 5 is made to emit light compulsorily regardless of 
photographic subject brightness, and the built-in flash plate 5 is forbidden is formed. Whenever it presses floor line 
mode setting key 1 1 arranged above said LCD 10, each mode of "automatic luminescence", "compulsive luminescence", 
and "prohibition on luminescence" switches cyclically, and selection setting out of one of the modes is carried out. 
[0030] Moreover, if selection setting out is possible for two kinds of compressibility, one eighth and 1/20, K, for 
example, it slides the compressibility configuration switch 12 to the right, compressibility K=l/8 will be set up, and if it 
slides to the left, as for a digital camera 1, compressibility K=l/20 will be set up. 

[0031] Furthermore, the mode setting switch 14 which carries out change-over setting out of "standard photography 
mode (single image photography mode)" and the "multiplex image photography mode" is formed in the right end upper 
part of the tooth back of the body section 2 of a camera. Standard photography mode is the mode in which the usual 
photography is performed, and multiplex image photography mode is the mode which continues and photos two or more 
sheets for a multiplex image processing. If the mode setting switch 14 also consists of a slide switch of two contacts, for 
example, it slides to the right, standard photography mode will be set up, and if it slides to the left, multiplex image 
photography mode will be set up. 

[0032] The cell material well 18 and the card material well 17 of a memory card 8 are formed in the base of the body 
section 2 of a camera, and loading opening of both the material wells 17 and 18 is blockaded with the clamshell type lid 
15. the digital camera 1 in this operation gestalt ~ four AA - the power-source cell which comes to carry out the series 
connection of the form dry cell is made into the driving source. 

[0033] Drawing 4 is the block diagram showing the control system of a digital camera 1. 

[0034] In the image pick-up section 3, said CCD303 carries out photo electric translation of the optical image of the 
photographic subject by which image formation was carried out with the macro zoom lens 301 to the picture signal 
(signal which consists of a signal train of the pixel signal received by each pixel) of the color component of R (red), G 
(green), and B (blue), and outputs it. A timing generator 3 14 generates various kinds of timing pulses for controlling 
actuation of CCD303 . 

[0035] Since drawing is fixed drawing, exposure control in the image pick-up section 3 is performed by adjusting the 
light exposure of CCD303, i.e., the charge storage time of CCD303 equivalent to shutter speed. When photographic 
subject brightness cannot set up shutter speed suitable at the time of low brightness, the unsuitable forward exposure 
depended insufficient [ exposure ] is amended by performing level adjustment of the picture signal outputted from 
CCD303. That is, exposure control is performed combining shutter speed and a gain adjustment at the time of low 
brightness. Level adjustment of a picture signal is performed in the gain adjustment of the AGC circuit in a digital 
disposal circuit 313. 

[0036] A timing generator 314 generates the actuation control signal of CCD303 based on the reference clock 
transmitted from the timing-control circuit 202. A timing generator 314 generates clock signals, such as read-out control 
signals (a Horizontal Synchronizing signal, a Vertical Synchronizing signal, transfer signal, etc.) of the timing signal of 
for example, integral initiation / termination (exposure initiation / termination), and the light-receiving signal of each 
pixel, and outputs them to CCD3 03. 

[0037] A digital disposal circuit 313 performs predetermined analog signal processing to the picture signal (analog 
signal) outputted from CCD303. A digital disposal circuit 313 has a CDS correlation duplex sampling circuit and an 
AGC (automatic gain control) circuit, reduces the noise of a picture signal by the CDS circuit, and performs level 
adjustment of a picture signal by adjusting the gain of an AGC circuit. 

[0038] The modulated light circuit 304 controls the amount of luminescence of the built-in flash plate 5 in flash plate 
photography in the predetermined amount of luminescence set up by the whole control section 21 1. In flash plate 
photography, if the reflected light of the flash plate light from a photographic subject is received by exposure initiation 
and coincidence by the modulated light sensor 305 and this light income reaches the predetermined amount of 
luminescence, a luminescence stop signal will be outputted to the flash plate control circuit 214 through the whole 
control section 21 1 from the modulated light circuit 304. The flash plate control circuit 214 answers this luminescence 
stop signal, luminescence of the built-in flash plate 5 is stopped compulsorily, and, thereby, the amount of luminescence 
of the built-in flash plate 5 is controlled by the predetermined amount of luminescence. 

[0039] A/D converter 205 changes each pixel signal of a picture signal into a 10-bit digital signal in the body section 2 
of a camera. A/D converter 205 changes each pixel signal (analog signal) into a 10-bit digital signal based on the clock 
for A/D conversion. 

[0040] In the body section 2 of a camera, the timing-control circuit 202 which generates the clock to a reference clock, a 



http://www4.ipdl.jpo.go.jp/cgi-bin/tran_web_cgi_ejje 



8/23/2004 



Page 5 of 10 

timing generator 314, and A/D conv^^205 is formed. The timing-control circui^^ is controlled by the whole 
control section 211. 

[0041] The black level amendment circuit 206 amends the black level of the pixel signal (henceforth pixel data) by 
which A/D conversion was carried out with A/D converter 205 to the black level of criteria. Moreover, the white 
balance circuit (henceforth WB circuit) 207 performs the level conversion of the pixel data of each color component of 
R, G, and B so that a white balance may also be doubled and adjusted after gamma amendment. The WB circuit 207 
changes the level of the pixel data of each color component of R, G, and B using the level-conversion table inputted 
from the whole control section 211. 

[0042] A gamma correction circuit 208 amends the gamma characteristics of pixel data. A gamma correction circuit 208 
has six kinds of gamma amendment tables on which gamma characteristics differ, and performs gamma amendment of 
pixel data on predetermined gamma amendment table according to a photography scene or photography conditions. 
[0043] An image memory 209 is memory which memorizes the pixel data outputted from a gamma correction circuit 
208. The image memory 209 has the storage capacity for M frames. That is, when CCD303 has the pixel of a n line m 
train, an image memory 209 has the pixel data storage capacity for a Mxnxm pixel, and is memorized in the pixel 
location where each pixel data corresponds. 

[0044] VRAM210 is the buffer memory of the image data by which a repeat display is carried out to the LCD display 
10. VRAM210 has the image data storage capacity corresponding to the number of pixels of the LCD display 10. 
[0045] Media Interface Connector is a microphone combination loudspeaker, as mentioned above. In case the video 
signal mentioned later is displayed, voice separation is carried out by the whole control section 211, and the sound 
signal in a video signal can hear it with this loudspeaker Media Interface Connector. 

[0046] In a photography standby condition, after predetermined signal processing is performed by A/D converter 205 - 
the gamma correction circuit 208, while each pixel data of the image picturized by every 1/30 (second) by the image 
pick-up section 3 is memorized in an image memory 209, it is transmitted to VRAM210 through the whole control 
section 211, and is displayed on the LCD display 10. Thereby, a photography person can check a photographic subject 
image by looking with the image displayed on the LCD display 10. Moreover, in a playback mode, after signal 
processing predetermined in the image by which reading appearance was carried out from the memory card 8 with the 
whole control section 21 1 is performed, it is transmitted to VRAM210 and a repeat display is carried out to the LCD 
display 10. 

[0047] Card I/F212 is an interface for performing writing of the image data to a memory card 8, and read-out of image 
data. Moreover, I/F213 for a communication link is an interface for making possible external connection of each 
network connection device 19, such as a personal computer, and the communication link of a digital camera 1, for 
example, is based on IEEE 1394 specification. 

[0048] The flash plate control circuit 214 is a circuit which controls luminescence of the built-in flash plate 5. The flash 
plate control circuit 214 controls existence, the amount of luminescence, luminescence timing, etc. of luminescence of 
the built-in flash plate 5 based on the control signal of the whole control section 211, and controls the amount of 
luminescence of the built-in flash plate 5 based on the luminescence stop signal STP inputted from the modulated light 
circuit 304. 

[0049] RTC219 is a clock circuit for managing photography time, and is driven with another power source which is not 
illustrated. 

[0050] The control unit 250 is constituted from a mode setting switch 14 etc. by the Up key 6 mentioned above, the 
Down key 7, the shutter release 9, floor line mode setting key 1 1, the compressibility configuration switch 12, and the 
pan. 

[0051] Said WB sensor 21 and blurring sensor 320 are connected to the whole control section 211. that to which, as for 
the blurring sensor 320, a photography person detects blurring when photoing the digital camera 1 with the stock - it is 
- a location - a variation rate - it consists of gyroscopes which have a detection function. Moreover, the sensor (not 
shown) by which the whole control section 211 detects the capacity piece of each power source is also connected. 
[0052] The whole control section 211 consists of a microcomputer, controls organically actuation of each part material 
in the image pick-up section 3 mentioned above and the body section 2 of a camera, and carries out generalization 
control of the photography actuation of a digital camera 1 . 

[0053] Furthermore, the whole control section 21 1 is set in the condition that the mode setting switch 14 is set as 
multiplex image photography mode. Said blurring detection sensor 320, said WB sensor 21, the modulated light sensor 
305, a non-illustrated ranging sensor, From the information acquired by the sensor which detects a dc-battery (cell) 
piece The abnormalities under photography, for example, blurring, and a shelter cross. A condition, sudden change of 
incident light, The condition that there is a possibility that the image which is not desirable for multiplex image 
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processings carried out after that, su<^^a cell piece, may be obtained is detected^fcie obtained photography image 
functions also as a malfunction detecWw means to detect that it is the image whicl^Riot desirable for a multiplex 
image processing. And when abnormalities are detected, processing by multiplex image photography mode is once 
suspended, and it functions again also as a control means on which it displays that the multiplex photography image was 
failure so that it may mention later. 

[0054] Furthermore, the whole control section 21 1 has the number counter of images which counts the number of sheets 
of the photography image for multiplex photography. 

[0055] Moreover, as shown in drawin g 5 , the whole control section 21 1 is equipped with brightness judging section 
21 la for setting up an exposure control value (shutter speed (SS)), and (shutter speed SS) setting-out section 21 lb. 
Brightness judging section 21 la judges the brightness of a photographic subject in a photography standby condition 
using the image captured by every 1/30 (second) by CCD303. That is, brightness judging section 21 la judges the 
brightness of a photographic subject using the image data memorized in updating in an image memory 209. 
[0056] Brightness judging section 211a divides the storage area of an image memory 209 into nine blocks, and 
computes the brightness data which represent each block using the pixel data of the color component of G (green) 
contained in each block. 

[0057] Shutter speed setting-out section 21 lb sets up shutter speed (reset time of CCD303) based on the judgment result 
of the brightness of the photographic subject by brightness judging section 211a. Shutter speed setting-out section 21 lb 
has the table of shutter speed. 

[0058] Shutter speed is initialized to 1/128 (second) at the time of camera starting, and shutter speed setting-out section 
21 lb carries out modification setting out one step at a time from initial value in a photography standby condition at a 
high-speed or low-speed side according to the judgment result of the brightness of the photographic subject by 
brightness judging section 211a. 

[0059] Moreover, the whole control section 21 1 is equipped with scene judging section 211c which judges four kinds of 
photography scenes, a "low brightness scene", an "inside brightness usual scene", an "inside brightness backlight 
scene", and a "high brightness scene", in order to perform setting out of suitable shutter speed, gamma amendment, and 
filtering amendment (after-mentioned) according to a photography scene. It is usually the scene which needs indoor 
photography and a fill-in flash with a flash plate 5 like [ at night ] photography, and the illumination light [ as opposed 
to the main photographic subject in an "inside brightness usual scene" ] (the natural light and the artificial light are 
included) is a follow light, and since the brightness is suitable for a "low brightness scene", it is a scene which can be 
photoed [ having no fill-in flash and ]. Moreover, although the "inside brightness backlight scene" is suitable for overall 
brightness, since the illumination light to the main photographic subject is a backlight, it is a scene with desirable flash 
plate luminescence, and a "high brightness scene" is an overall very bright scene like photography in the sea and the 
skiing area of fine weather. The judgment result by scene judging section 21 lc is memorized by memory 21 Id. 
[0060] Furthermore, the whole control section 21 1 is equipped with image judging section 21 le which judges whether 
image pick-up images are images (this kind of image pick-up image is hereafter called natural drawing.) of the usual 
photography, such as scenery and a person, or they are images (an image similar to this kind of binary image is hereafter 
called alphabetic character drawing.) drawn on the feltboard etc., such as an alphabetic character and a graph. 
[0061] Image judging section 21 le creates the histogram of the brightness data of each pixel location based on the pixel 
data which constitute the image pick-up image memorized in the image memory 209, and judges the content of the 
image pick-up image based on this histogram. 

[0062] Generally, in the case of alphabetic character drawing like [ although there are few biases of luminance 
distribution in the case of natural drawing and the histogram of the brightness data of an image pick-up image serves as 
the so-called 1 crest distribution which has one peak value ] the alphabetic character drawn, for example on the 
feltboard, the bias of luminance distribution is looked at by a white part and the black alphabetic character part, 
respectively, and it becomes 2 crest distribution. Therefore, image judging section 21 le distinguishes whether an image 
pick-up image is natural drawing or it is alphabetic character drawing by distinguishing whether the histogram of the 
brightness data of an image pick-up image is 1 crest distribution, or it is 2 crest distribution. And this judgment result is 
also memorized by memory 21 Id. 

[0063] It had 21 If of filter sections which perform filtering processing in order that the whole control section 21 1 may 
perform record processing of the above-mentioned photography image, and 21 Ig of record image generation sections 
which generate a thumbnail image and a compression image, and in order to reproduce the image recorded on the 
memory card 8 to the LCD display 10, it has in 21 lh of playback image generation sections which generate a playback 
image. 

[0064] 21 If of said filter sections amends the high frequency component of the image which should be recorded by the 



http://www4.ipdl.jpo.go.jp/cgi-bin/tran_web__cgi_ejje 



8/23/2004 



Page 7 of 10 

digital filter, and they amend image <^fey about a profile. 21 If of filter sections j^Bkiipped with a total of five kinds 
of digital filters of the digital filter wW performs standard profile amendment ab^^ach of compressibility K=l/8, 
and 1/20, and two kinds of digital filters which strengthen a profile to this standard profile amendment and two kinds of 
digital filters which weaken a profile. 

[0065] 21 lg of said record image generation sections generates the thumbnail image and compression image for reading 
pixel data from an image memory 209, and recording on a memory card 8. They read pixel data every 8 pixels in the 
both directions of a longitudinal direction and a lengthwise direction, respectively, scanning 21 lg of record image 
generation sections in the direction of a raster scan from an image memory 209, and one by one, it is transmitting to a 
memory card 8, and they record them on a memory card 8, generating a thumbnail image. 

[0066] Moreover, 21 lg of record image generation sections reads all pixel data from an image memory 209, and they 
perform predetermined compression processing by JPEG methods, such as two-dimensional DCT conversion and 
Huffman coding, to these pixel data, generate the image data of a compression image, and record this compression 
image data on this image area of an archive medium 8. 

[0067] As the image recorded with the digital camera 1 is shown in drawin g 6 , the image of 40 coma can be memorized 
with compressibility 1/20, and the image data (640x480 pixels) of the high resolution into which each coma 81-85 was 
compressed in the part and JPEG format of a tag, and the image data for a thumbnail display (80x60 pixels) are 
recorded. It is possible to treat as an image file of for example, an EXIF format in each coma unit. 
[0068] In photography mode, if photography is directed by the shutter release 9, the whole control section 21 1 usually 
The thumbnail image of the image captured after photography directions in the image memory 209 and the compression 
image compressed with the JPEG method by the compressibility K set up by the compressibility configuration switch 12 
are generated. Both images are memorized to a memory card 8 with the tag information (information, such as a coma 
number, exposure value, shutter speed, compressibility K, a photography day, photography time of day, data of turning 
on and off of the flash plate at the time of photography, scene information, and a judgment result of an image) about a 
photography image. 

[0069] If photography is directed by the shutter release 9 like the above when multiplex photography mode is chosen 
The thumbnail image of the image captured in the image memory 209 after acquiring the image for N sheets to an image 
memory 209, The compression image compressed with the JPEG method by the compressibility K set up by the 
compressibility configuration switch 12 is generated. The actuation which memorizes both images to a memory card 8 
with the tag information (information, such as a coma number, exposure value, shutter speed, compressibility K, a 
photography day, data of turning on and off of the flash plate at the time of photography, scene information, and a 
judgment result of an image) about a photography image is repeated N times. 

[0070] By the way, processing which compounds a single image is performed for the various object as follows from a 
multiplex image processing, i.e., two or more images which photoed the same photographic subject continuously and 
acquired it. 

(1) To the approach same photographic subject which acquires a super resolution image, shift a little camera station and 
photo two or more images. The image of one sheet which raised resolution is obtained from two or more images with 
which these sampling phases differ. 

(2) depth control ~ change depth of field, without operating drawing actually. When a photographic subject has distance 
distribution, in the case of a foreground and a background, a hint is doubled with a foreground and a background and a 
photograph is taken, respectively. The image (omnifocal-lens image) which had the focus in both the foreground and the 
background, the image which emphasized dotage of a background are obtained from the image of these two sheets. 

(3) Compound the image which changed gradation control exposure level and was photoed twice, and open the dynamic 
range on appearance. The gradation property (gamma curve) of a synthetic image is operated, and it is made the optimal 
tone reproduction for a scene. 

(4) Blur and obtain an image without blurring by stopping, proper shutter speed's being S seconds, carrying out N sheet 
photography (TxN=S) in shutter speed T seconds of extent which does not carry out blurring when blurring is likely to 
occur on the condition, and compounding those images. 

[0071] Next, in a digital camera 1, the actuation at the time of performing standard photography (single image 
photography mode) is first explained briefly with reference to the flow chart of drawing 8 . In addition, in the following 
explanation and a drawing, a step is written as S. 

[0072] If a shutter release 9 (release) is pushed by actuation of a photography person by SI 01, exposure will be started 
in S102. After predetermined exposure is completed by S103, in S104, image processings, such as white balance 
amendment, a gamma correction, noise rejection, color correction, and color emphasis, are performed, for example. In 
addition, after predetermined exposure is completed, and storing temporarily at buffer memory, it may process. By 
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SI 05, image information is memoriz^Aa memory card 8 after image-processing ^^ination (SI 05). 

[0073] Below, in multiplex image ph^Paphy mode, the actuation in the case of p^rorming malfunction detection 

under photography is explained with reference to the flow chart of drawing 9 . 

[0074] By S201, mode setting is performed according to the mode setting actuation by the photography person. By 
S202, if a shutter release 9 (release) is pushed by actuation of a photography person, it will display that it is photography 
by multiplex image photography mode on said display 432 S203. Thereby, as for a photography person, it turns out that 
the mode of the present ** is multiplex image photography mode. 

[0075] If exposure is started by S204, the whole control section 21 1 will judge during exposure whether multiplex 
image photography has gone wrong by S205. If normal (the judgment of S205 is NO), exposure will be completed by 
S206 and the image photoed by S207 will be made to store temporarily in an image memory 209. 
[0076] Then, in S208, it judges whether the number of photography images has become the count of predetermined 
which multiplex image photography mode takes. If it has not become the count of predetermined (the judgment of S208 
is NO), it returns to S204 and predetermined actuation is repeated. If it becomes the count of predetermined (the 
judgment of S208 is YES), it will display that multiplex image photography was completed on a display 432 by S209 (a 
display is erased). Subsequently, the white balance of the image memorized in the image memory 209 etc. is processed 
by S210, and a memory card 8 is made to memorize the data of all images in S21 1 . 

[0077] In said decision of S205, if the abnormalities under multiplex image photography (failure) are detected by the 
whole control section 211 (the judgment of S205 is YES), the whole control section 211 will suspend processing in the 
usual multiplex image photography mode, will erase the display of it being S212 and being multiplex image 
photography by the display 432, will be S213, and will display what multiplex image photography failed in the display 
431. 

[0078] And the dialog for making it choose whether it leaves a part from from is displayed on said LCD display 10 
among whether it leaves all the images photoed to the photography person by S214, and the image currently photoed. A 
photography person's selection of an image performs image processings, such as white balance amendment about the 
image which progressed to S210 and was chosen. Subsequently, in S21 1, the selected image is memorized to a memory 
card 8. Of course, the method of memorizing all or some of photoed image to a memory card 8 automatically, without 
passing through a photography person's selection is also effective. 

[0079] At the time of this image selection, as shown at draw ing 10 , the compression image SV by the thumbnail is 
displayed on said LCD display 10. Since a photography person can move the arrow head P on a screen to an arbitration 
location by carrying out selection actuation of said UP key 6 and the DOWN key 7, it can switch selection / un-choosing 
by pushing in and operating said shutter release 9, where the desired image SV is pointed at. [ of an image ] In addition, 
about the selected image, it is made for the burster trimmer stacker feature Sa of the thumbnail image SV to be ****, 
and the image selection condition is intelligible here. The approach of arbitration, such as making it the color of whole 
image SV change etc., can be used for this image selection condition. 

[0080] Furthermore, when it lapses into a power-source piece, by telling failure of multiplex image photography, cells 
etc. are exchanged, and multiplex photography for the second time can be directed, and also a photography person 
becomes possible [ also daring save a photography image as a single image ]. 

[0081] In addition, if the display 433 of being multiplex image photography is formed in the front- face side of a digital 
camera 1, for example, the front face of the image pick-up section 3, as shown in drawing 1 1 other than the display 432 
in said finder (LCD display 10), a photographic subject person can be told about multiplex being under photography, 
and photographic subject migration etc. can be prevented. 

[0082] Next, in multiplex image photography mode, the actuation in the case of performing malfunction detection to the 
photoed image is explained with reference to the flow chart of drawing 12 . 

[0083] First, by S301, if multiplex image photography mode is set up and a shutter release 9 (release) is pushed by 
actuation of a photography person by S302, it will display that it is multiplex image photography on a display 432 S303. 
Then, exposure is started by S3 04. After exposure is completed, an image memory 209 is made to memorize the 
photoed image by S305 S306. 

[0084] Subsequently, in S3 07, it judges whether the number of photography images has become the count of 
predetermined which multiplex image photography mode takes. If it has not become the count of predetermined (the 
judgment of S307 is NO), it returns to S304 and predetermined actuation is repeated. If it becomes the count of 
predetermined (the judgment of S307 is YES), in S308, it will display that multiplex image photography was completed 
on the display 432 in a finder (a display is erased). 

[0085] Then, the whole control section 211 judges whether multiplex image photography went wrong from the content 
of image data, or the number of image data by S309. If normal (the judgment of S309 is NO), image processings, such 



http :// www4.ipdl .jpo . go .jp/cgi-bin/tran_web_cgi_ejj e 



8/23/2004 



Page 9 of 10 



as white balance amendment, will b^Hed to all the images stored temporarily ii^™image memory 209 by S3 10, and 
a memory card 8 will be made to meWRze the image information of all images b^Wl 1 . 

[0086] When blurring of an image is further conspicuous although the number of images is satisfied when the number of 
images for which the photography person asked cannot be being photoed, or abnormalities, such as black crushing and a 
white jump, have occurred It detects that the whole control section 21 1 is abnormal (the judgment of S309 is YES), the 
whole control section 211 suspends processing in the usual multiplex photography mode, and it is S3 12, and displays 
that multiplex image photography went wrong on the display 43 1 in a finder. 

[0087] The dialog for making it choose whether it leaves a part from from is displayed on a display 10 among whether 
next it leaves all the images photoed to the photography person by S3 13, and the image currently photoed. A 
photography person's selection of an image performs image processings, such as white balance amendment about the 
image which progressed to S3 10 and was chosen. Subsequently, in S3 1 1, the selected image is memorized to a memory 
card 8. Of course, you may make it memorize all or some of photoed image to a memory card 8 automatically, without 
passing through a photography person's selection. 

[0088] Thus, although the number of images for a multiplex image is filled, since the appearance of the last composition 
image worsens under the effect of the defect image when blurring of an image is conspicuous or there is a defect image 
which abnormalities, such as black crushing and a white jump, have generated, it is not fit for a multiplex image 
processing. That is, the deletion of a defect image of a photography person is attained by the stop of multiplex image 
photography mode processing. 

[0089] By the way, even if the image photoed in multiplex image photography mode was unsuitable as a multiplex 
image-processing object, when a moment for a good picture is missed, it is sometimes difficult to photo the same scene 
again. Also in such a situation, a photography person can leave a memory card 8 as it is by carrying out preservation 
actuation of the image not as the object image of a multiplex image processing but as a single image. 
[0090] In that case, you may make it make the image which should be saved among two or more images photoed for the 
multiplex image processing choose automatically with a digital camera 1 . 

[0091] In addition, when a photography person makes only a required image record on a memory card by choosing a 
desired thing among two or more images photoed in multiplex image photography mode, economization-ization of the 
capacity of a memory card 8 can be attained and there is effectiveness which can record many images. 
[0092] As mentioned above, although 1 operation gestalt of this invention was explained, this invention is not limited to 
the above-mentioned operation gestalt. For example, although it was made to display an unusual thing on a display 
means while suspending processing by multiplex image photography mode when the abnormalities which bar a 
multiplex image processing were detected, it is good also as what performs only either a halt of multiplex image 
photography mode or the displays of an unusual thing. Moreover, when abnormalities are detected, retry of multiplex 
image photography may be directed. 

[0093] Moreover, although explained as what performs independently malfunction detection under photography, and 
malfunction detection based on the image data after photography, it is good also as a configuration performed within the 
same multiplex image photography mode. 

[0094] Moreover, although the display 431 which displays abnormalities on the LCD display 10 as a view finder, and 
the display 432 which indicates that it is a multiplex image image pick-up were formed, when the digital camera is 
equipped with the finder of optical or an electronic formula, a display 431 and 432 may be prepared in this finder. 
Moreover, a display may consist of light emitting diodes instead of liquid crystal etc. In addition, although said display 
may be prepared in parts other than the finder section, the direction prepared in the finder through which the 
photography person is always looking into the photographic subject image during photography is desirable at the point 
which can raise the visibility of a display. 

[0095] Moreover, although the case where an external instrument performed a multiplex image processing and a digital 
camera performed from photography to record of an image was shown, a digital camera may be made to be equipped 
with a multiplex image-processing fiinction. 
[0096] 

[Effect of the Invention] According to invention concerning claims 1 or 2, when abnormalities are detected during 
photography, since processing by multiplex image photography mode is suspended, processing by multiplex image 
photography mode is continued automatically, and the defect image pick-up image corresponding to these abnormalities 
can lose the inconvenience automatically incorporated as a multiplex image-processing object, and can prevent 
generating of the unsuitable last generation image beforehand. 

[0097] According to invention concerning claim 3 or 4, a photography person can recognize easily that multiplex image 
photography went wrong with a display means. 
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[0098] According to invention concec^^ claim 5 or 6, when abnormalities are det^M during photography, or when 
abnormalities are detected by the obtaHBT image, since processing by multiplex iml^Fprocessing mode is suspended, it 
is lost that the defect image pick-up image corresponding to these abnormalities is automatically incorporated as a 
multiplex image-processing object, and generating of the unsuitable last generation image can be prevented beforehand. 



[Translation done.] 



http://www4.ipdl.jpo.go.jp/cgi-bin/tran_web_cgi_ejje 



8/23/2004 



Page 1 of 5 



* NOTICES * 




Japan Patent Office is not responsible for any 
damages caused by the use of this translation, 

1. This document has been translated by computer. So the translation may not reflect the original precisely. 

2. **** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 
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f5U>X301<b. I4(cStCCD (Charge 
Coupled Device) 30 3^(D^t^^m 

^frhtezmmmmzmv. »?ft©*f«i4ccD3 

40 0 3 (D^ilS-C^iEJfe $ ftfcH^fl-SttC «fc 0 S ft 

[0 0 2 2] — -X. *>7*^g|52}* > LCD (Li q 
uid Crystal Display) A^&Sjg 
S^gBlO. SZm^f-f T<D—Mt bX<Dji F 8 

<D§I#315 1 7 % 6 tftt ^- v n > Aj: i'AJ^gp^^ g ft £ Jg 

^i34Wb, itLr±ia}i»siJ3-caxoiiSft 
fciBMi^4CB»fS(D{f meimzte Lfc^. l c d^sp 

1 0^<D^t5R. F8^©lBli. ^-vt^a 

>f^-^^<!:<D^^ (04) 19-x 

50 ©iK^c^ffl^^^fe^r-*?,. 
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[0 02 3] H§{£3R3<DrtgWU£. }gi£U>X3 0 1 ** 
CD*7-i , J7'fe>t3 0 3 (S4 ) ZffiTLtcm&lnl 

7^ vis* ytcowMftfr h (Dfcmytz^yt-? zmyt-t > 

V3 0 5*«*.fc3BfcH»3 0 4 (@4) ^f>nt 

[0024] P3#;-fe>lJ-3 0 5», »UU>X3 0 1 ^ 
©AS*^£&fflT*&^*9* W*««S?u>X3 
0 1 ©Sl*A«5tt^«ttI -o/cO b/tCD£t£ti3T*C 4 10 

[0 02 5 ] £6&c. iMKS3rt<D9Bf(C». h* 
jt5>X (WB) *fe>1^2 1, SJ&feVU- 
&i*^SW6tXTC^o WB-fe>1f2 ltt, *^feSg 
^ajkTO^Q*'?^ F^>X*Srarr*/c«><D<> 

(af) ffliut, «^tt*-e©ffi**ww-r&. 

[0 0 2 6 ] ^7^^*^2(Dbu®CC«, Sl^/^T<fc 

/c, ^*(*gP2<0±®^:«, 13 1 ct^f <£5Ct, BS 

6, 7#Rtt64vCl>*. ^-(?^6tt, IBIiHi^SrrJ 

tc#><Db<D (KTF, Up*-iC^. X-f* 

-?&tc&)<Di><D («T, Downt-il,^. ) r<5 
£ 0 ^®BJ <0 2<9>ffi®^ii5fflJ) WltDow 

n*~7<DiE.ffllCA : *:VJj- F 8 «CiE»3 *i/cEi«*?i3 
ST 4fc«>0?fi* X ? ^ D*JRW 6*1, Up*- 6© 30 
fiflPJCC f + v * - # f > 9 *SR W 6 ft T l ** . 
[0 0 2 7 ] *^7*(*aB2©WffiK:tt t E2CC^Tcfc 

5/c#<DLCD3l^9n 0*W»6tiTC»4. £/cLC 
D^^SPl 0ftOT9SM*£fc:te> H7CC^J:5«:. ^ 

- F^<DJSS?r** C 4 «r*iR-r **7j*gM 3 2 #RW 
htlXte*). »K«#W¥#©B«vp€:aBr*i# 40 

Ch6«5W4.3 1. 4 3 2<MMB£S©K:r&* 
J:^^oU^ 0 £/c, ±ELCD*ffiSSl 0©T^ 
ftJBtett* y*y#- F8 teKftSftSBHRf*--*©^ 
ffl*K*«)»R3E"r&)fc«)«)BE«*R3t^7-r FX-f ? 

fps^gw^nti^o £/c, #^#{«p2<Dj»«ft 

»3flB©»M«ctt % iKftttSS^-l 3**RW6ftTtr> 
[0 0 2 8] *y-5*^8P2CCtt. *^«:I2» 
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[0 029] mFlB-r^^^^^ ^ l cctt, 77-;ya 

??f»5*ft%3#* rg«,^^e-Fj . Mi*** 

±T2> rfBfcStih*- FJ aWWeh, hu IB LCD 1 0 
<D±^CCE^$n/cF L*r- FRJE*- 1 1 

-F***-f*y **tc#J9J&b*K ^m^CD^r-F^ 
S1RR5E $ ft* J: ^ (etc o r t>£ 0 
[0 0 3 0] f^^^y^ltt, 1/841/ 

2 0CD2aSCDffiffi^K^iMJR^^Dj#gr^0 v 

K=l/8««£Sti. S^CX^^F*r^<h. lESS^K 
= l/2 0 3WRJESti*. 

[0 03 1 ] 3 e>K, "7*i*gP2 ©Wffi<0««8J:» 
«ctt. r«aHMB*-F (»HMBWt-F) J 4 
r^«B««IB*-Kj 4*«WfcR3E-r**-FR3e^ 

-f»^i4#R»6*irc>*. «»««5*-Ktt. a» 

(D^*«K«:tf $*-FC*9. ^milj^i?^- F 

!HB*-FtfR£3ti. 2Etcx^^ FT* 4. ^Ht 
tUe«-*F««tS3ti*. 
[0 03 2] ^^^^f*SB2CDJSSCC«, 1 
8 4-^* l J^7— FttAS 1 7 4#RW 6^1. 

IBtCfcfcr*^*^*^^ 1«, 4*<D#=JBft«?ft4 
HJ>JSS»Ura:*«HWft«:Wtt»4 UTl^* 0 

[0033] H4«. f 5 ^*^*-?*^ i©iwap»ts%-r 

[0 034] JS«g|53rtCCfc^r, lulBCCD3 0 3 
<Dlt¥&*. R <*> , G (4ft) , B («) <D&im<D 

*ft#) «c3erafto-cm*r*. 

-£3 1452, CCD3 0 3©Ig«l*ftlB»-r*/c«)6DS 

[0 03 5] MflW3€Ci»»*littlMM« % %t*)*Wfc 
KOi&otl^OT, CCD3 0 3^m "Tttto 
^ Sy^ y dr-Xtr-FCCffl^r*CCD3 0 3<DS®f 

a«jtts/+ F*jR3er#«cc»»*tt. cc 

D3 0 3*>e>ffi*Sn*ffl«fi^©u^;I/Hll*tf 5C 
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SSgtt. M^ffiElK3 1 3rt<DAGClil8S<D^>r>l9 

[0036] ^-{^>^x^U-^314^ ^ ^ 
>^*0»iaB2 0 2*><bi*fI2*i*S*I^P * 
CitCCD30 3 OSgi&*U©fI-^3:£j&"f £ fc<D"C* 

^^$>^x^U-^3 14«. M^lfli^Hld- 
/Wt (KtH»*&/»T) <D^-Y $>y«-^, &HB£<D io 

* G&flmt) »©*n**fl»*£«SU CCD3 
0 3<ctftfrr&. 

[0037]i^«liB3 13tt, CGD303^e> 

e^«ffli*J!rrfe©^»^. ft^jeaBK3 nit c 

DSfflHZJW->:7 p y>£0 0ffi<tAGC d*--h*W 
>3>hn-jU) B»i**b» CDSHB«cJ:0BHfc 
(l-^CDy>fX<DfiSE«r?fl^ AGCHffioy>f>«:SllS 
•T 2> C <h CC J: 9 BMMt-sf <D U^^SBS^f 5 o 20 
[0 0 3 8 ] i@7felBlK3 0 4te. 7 "5 yzs^mMZlCteV 

i^my^y^»B<omtm^itmms»2 i ioc<fc«r 

0 4 3&>^«*JI»S»2 1 lt^lt7 7?S/*WBR 
2 1 4CC«3W±ff^#HU#S*i*. 77-r>a$I]ii 
582 l 4 tt. c©»*ff±fi#«:jESLrrtja7 ^ 7 u 

[0039] *y^*f*«2rtec*jc*r, a /Drafts 

;Ml#«:aj*-r*«>©"C**. A/DS3ftg2 0 5tt. 

A/D^»ffl©^i3^^ccS^iirSiii3Rm# (r^a 
#{t-*t) * 1 0 tr^ KD^^^-rt/M^cc^jftr*. 

[0040] #y ^#f*SP2ftKlte: v ffll^D^, £ 
-f5>^x*U-^3 14, A/DS»S2 0 5(C» 
-T S * * ? * -5 # A X > ^ttlfBISBg 2 0 2 tftt 

tt6*TCl>S. *-f 5>ym»HB2 02«, £ftiMfP 40 
SC2 1 1 CCctO*lH»Sti4- 

[0 0 4 1 ] »1/^<JM|BEHB2 06» t A/D^&2§ 
2 0 5rA/DS»StifcHUR(t# (fcO\ HBR-r-* 

"C*^o $fc, h^>*H» <«T. WBJhISS 

2 07(t r«IE^K:*y^ h'<^ 
■l*TPB£«*ft<5<fc5CC, R, G, B<D&feJ*#<DiIi5R7 r 
-*©u^jl£Hft*fr WBUK2 0 7 

^•0992 1 l*>6AA3nS, U^US*^- 
^tffll^R, G, BO&e^WJiffiJftf 5 --*©!^ 50 
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[0 04 2] rl$IEI5ISS2 0 8tt, BBIRf*- ^©T^tt 

[0 04 3] MM* If 2 09 tt, r«EI»2 0 8* 

y^»J2 0 9te:, U~A#<DiEttSM£WOx:t,> 

BHM*'; 2 0 9«\ CCD30 3^n 
tfm^JtPIIiSfr&Wl/TC***^ Mx n x mllj^^(7)ilj 

[0044] VRAM2 10«, LC D^iftSn 0 CCS 

tI^^n»f-^^7^^'jr*So vr 

AM2 1051 LCD^Bfl 0CDiH3RJ»tC*tj£UfcH 

[oo45]mic(i bu^u/c^^cc, -?«<vmm* 

B*«ft^*0§^f^^f*§!JfflI§P2 1 

[0046] »iesWtt««:fct\rtt. »«gP3 cc J: 0 
1/3 0 («?) CCCMStlAimkOfMlBR^ jr«s t 
A/DS»g2-0 5-t«jE@!82 0 8 tc <fc 9 BfJ&Dfi 

^mmifiM2titc& % m&s*: v 2 0 9 ccietfts 

ifeCC. ^f«MffllS$2 1 14MTVRAM2 1 0 CC(£ 

lcd«s«i o^sn^ cnccj:9» 

LCD^l Otca^Sn/cHftCCcfcOtS^ 

as2 1 irKe<DA««uBKii3-tiA:a. v ram 2 1 

occissisn,- LCD^Wl OCCS^S^Sti^. 
[0 04 7] *-F1/F2I2B, «»;*-F8^ 

tc*b<D«(>2-y *-X-C$>Z 0 *fc. i«fflI/F2 
1 3«, -r^^^^^^ 1 ^-vt;l/3>ha-^^c 

<b*©** - zmm&m 1 9 &9flnvttcc^flnRM 

3 9 4«ttCclW»UT^4. 
[0048]777S/*l«li»2 14tt % 

3S2 1 4«, ^«JJ^pgP2 1 I ©W«i*-*«:ai^c»rrt 

[0049] RTC2 191J, JSSJ0B#*^ST^/c«) 
[0050] »fW2 5 0tt, Mlfc 
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1 1 > EM^fcm 1 2, ?6«:(i"t-KIS 
[005 1] £#3^352 1 1 Ktt, g?lCWB^>1f2 

[0 0 5 2] ±#fclW%K2 1 v^^P^yfa- 10 

[005 3] 2 hie* i£&mW$#2 1 1 t*. Fl£5£ 

i 4#^»®{£iif£- : e- Kccss$nn»4« 

>1f2 1, SB5fc-te>lJ-3 0 5. ^l^<D$J^-fe>1J\ 

*^y «j*i*«W"rs42>if«ecj:orf#6n 

flttU&e— FteJ:4JM*C»oft^fM:L." ^SMUlIi 

[0054] $ h^C. ±t*fflWM2 1 1 tt, ^Mtfgffl 

[0 05 5] g/c, B5Cc5VrJ:5fc:* ^&*IJ®a52 1 
1«, StB©J®ffi <5/*»*-*tr-F (SS) ) £R 
^T£/t#><Z)8¥gflS3B2 llai, ^t^-Xf- 
F ( S S ) 1£^9$2 1 1 b t&ffi&X SBItt*iJ5E8P 
21 laiJ, *lgfip«tt»6c*yc^r. CC D 3 0 3 CCd: 
0 1/30 (SO ««:K0ii**i4Hi««:*UfflO'C»¥ 

SP2 Halt HIM* 'J 2 0 9CCJEffWtClBtt3tl4 
[0 056] »8EWE«2 1 1 att, BiflM^y 209 

[0 05 7] j/t?>-XK-F«E« 1 1 btt. tt 
S99|je»2 1 1 a«C«fcS»3f#(DWS3©flS»*«ca 
-5C*-C^*?r*-^fcr-F (CCD3 0 3<D«#B$|ffl) 
*SS-T4fea>t?*S. i'i* * FIKESB2 1 
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[0058]^t^-Xf-Ftt, ^y^^SbB^CCl 

/i 2 8 (#) ^fflss^nrfco. iWflnHflltc 
*$1>T, J/t9*-xtr- FRS92 1 1 b*s, JflSfl 
SSP2 1 l.afcJ:Sa^{*<0W6SO*lJete*«Cj£Dr 

««Mi*>6*a«t> o < ttffiaHMtci e-roCTts^^- 

[0059 ]^t £<*3HJ$PSP2 1 1 1* % tttR^->«: 

>j . ri|i«dBW!ts/->j . r4j«asi!^->j *> 

s/->14SV2 l i ctiJltus. rffij^g^>^>j 
art»I^>«HHBKO J: 5 «C. a*. 7 ^ * 2x* 5 

cd?S^^ * -iS-co}SiJ<D J: 9 (c^*Wk:^«c9l* ^ 
^>t*^ ^->*IJS352 1 1 cCCct^*J^*S^(J 

2 i i dccisi^2n& 0 

[0 06 0] $ ±#UW$$2 1 1 SMfcMfttf 

i£?&mmmu2 1 1 e ^fii^ri^ e 

[0 06 1 ] Bi4Mm£92 llei^ ii^^'J 209 
SiBRffiiB©»a^^t^ h^A*ftBEO, CCD 
[0 06 2] -®iC, JS^lii^OiSS-r-^Ot:^ h y 

0 3&s^>ar<. i 

(B9*me>n, 20j»*itts. ee^r, m^^j^gp 2 
1 1 e«, m&m&oim&T-zcDtz f^^a^i oj 

^flJ-C*€>*\ 2 0j^ffi-C*-5^«:*iiglJ-rSCiCCj:D 

^> 0 fir, c<D*U£*s*fc^*u 2 1 1 dccietesn 
[0 06 3 ] £f*3HjflP8B2 i i « % _ttm&m&<Dtzm 

KM&ft stable, y 4)1,9 y> #mm&ft 5? 4)i>9 
SP2 1 1 f VJ** J >i<m&te<kVKMmWi*m&? 
4iBeEHft^JSSa52 1 1 y*y*-F8«c 

iB»3nfcia«%LCDS7S8Bi occB*-rsfca>«c % 

H*H»**rtTSII4BI«flfel«*2 1 1 h£«*TU 
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[0064] ffiiZ? J >b$U2. 1 1 f "risttfoy w 
lfii, ffiB^K=l/8. l/2 0C0^-n^nccoii 

[006 5] H?IBiel^liJ^^SSP2 1 lg(t pjfl^^ 10 
y 2 OSiPhmm^-Z^Wtfr&lsXJ*:*)*!- F8CC 

& 0 f^H«^jsse»2 i ig», hhr^ »; 2 o 9^e> 

[006 6] $/c, gES!B«*J5Ra2 1 1 git hmm 
*y 2 0 9^6:£®^-#£i^tf5U cn^copj^ 
f=— ^CC2^7CDCTg^, A7V>^b?©JPE 20 

[006 7 ] f^^U*^^ 1 tcJ:r>riB»Sti3feiB<R 
tt, 06tc^-Tck^^, EEffi^ 1/20T4 0 n-7CDI® 

J PEG^-CffiffiSn/cS^KOlSfiEf 1 -^ (64 
0X48 0if) i-y-A*-YJU3l^fl|(Z>iB«'7 s -^ (8 

ox60ii) *«b®3*iti»£. ftavMr, /ci 

[006 8] ±#Stfffil8P2 1 1 jlStJi §^e- FtCfc 

JMBtBftacciMM * y 2 o 9 ccffi d ii* n/cPi^o-y- 

a»<o«3eis*««ot»«) <t*«cpiBMfc*>* y f 40 
8 teeners. 

[006 9] F#yMRS*rCC»S 
JJEEWSfc^* ?*-#*>9«cj:D»f?#fg*§ft* 

i > m&s * y 2 0 9 «c n ti^coiii^^ixt# o/ciftec , 

iSft^^y 2 0 9CCffl9i&3^/ciB«©lJ- 

fc. EB*H3ex-<7?-l 2rga3e3n*:ffiB*KCCj: 

0 J PEG*SC«cj:DfflB3nfcElgBi«i**fiR0, 
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tffg) iftccHBB«*^^:y*- F8ccgets-rs«iffi* 
[0 07 0] ic^r, *aMMfiB. H-tt 

( 1 ) ja<g«aa«*ffif#T-s^ffi 

mzt§&?z>* *ti6if>^ r y>yfiLffi©stt4aa© 

(2) ^gn>hD-jU 

>h<D*oftJM* (gfltABNl) *WJft©HW*38aHb 

(3) pgia3>hp->u 

(4) ^n^c 

WES'* * *^*fcT- F**S«rc«9. *©*ttTtt? 
^-^tr- KT»tNft»K (TXN = S) L>, 

[0 07 1 ]^, 7is#Jl*jj* ^ 1 CCfcC^T. ^"T, 
tUmJtiJ H«aWIJ*-F) «rfT5IB<Dttft*ia8 

[007 2 ] S 1 0 it, WB«©aff«:J:0^+!>dr 
-^f^>9 (UU-X) *sffS-ti«&. S102T«, 

S10 4tlt h^^^>XffliE^^7> 

S 1 0 5 "C«, ili^t»$R^^^ y F 8 ccisti 
«.(S105). 

[0073] o^tc x ^mni^miJ^- F(c*5c*r, « 

[0074] «IB*«:J:**- FH«ff 

K:j£GT*-Fia^*?f5e S2 0 2T*, »«^CD»f¥ 

tcj:*)->+ ?r*-#*>9 (uy-x) ftsffsti«&, 

S 2 0 3 mifBS^g|54 3 2 CC^MP^JIU^:- F 

«^CD^r- F^SiB««K*- Ft?*SCi^^ 
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[0 0 7 5 ] S 2 0 4TB3lc* j ra>&3iiS<b. S2 0 5 
T\ ^*$IJ®SS2 1 1 ttS^tC^fflffii^lfi^ifetel/ 
Tl^^S^*^IW"r^o JKfttftttttltf (S2 0 5(D 
2pJJ£j&JNO) . S2 0 6tS7t3&*7l, S20 7t\ 

[0 07 6] C<Dt£, S 2 0 8 -Ctt, flRg5ffli«R«rt*^fi 

S^NO) . S 2 0 4CC^TF^(Dftf^£lg OilTo 
^rSlHl^CC^*rti« ( S 2 0 8 <D«5B&* Y ES), S 2 
0 9 3UnSB4 3 2 (c^lICdUg^T UcC t £ 
■WSfclTh (a^*j»f) o *C>*\ S2 1 0t, BMM 
*«J20 9«ClBttStiro*iIi«©*'7-/ F^>*^ 

c[)tea*tTi\ S2 i 1m ±~c<Dm&<D"r- % * * 
■=ey a- K8CciBlf.3-ti^o 

[0077] S51BS 2 05 ©WKCCfcor . £{*3HJ9P35 
2 1 1CCJ:0^SBS«»^*<DS^ *M*UJSti 
*i (S205©fl^YES) . £i*8HJ8PSf52 1 1 

2 12-C, «5^W4 3 2 6CJ:S^KlB«R»iJ'r*SCi 
<DS5**«iU S2 13T, 3 1 Ct^SHHftJB 

[0 07 8] fit, S214t 4 }gf£gCC>tfbr, {ft 

aiiR-r&i. S2 i octitA/r, ]giRLtcmmcn>x 

S2 1 1"C«. SlR3n/cffl&*-**U#- K8CCiSttt 
[0 07 9] COB«aBRB$K:*avt;, MiBLCD^ 

finals v*«*tSS tiro*. iM££u:. fuisup^- 

6feJ:^DOWN*--7«ra»a»ff-r*Ct«:J:0. Oil 
r, Bfa<z>Hi«sv*#-f >h U/cttBt?,- itulBv'* * 

JUMweoevr. ccr&s, A*^;uBMRsv<oiiSK 

0Sa#l**lC&5<fc5CCUr*9> BHfc«lRttJ8^» 

r#>£„ 

[008 0] 3 «iH«JtitcRBoA:i#a<k*K: fc % 

»g*iS«£#— iB«<!: ur»*.r«?rrs c i pjfrg £ 
as. 
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[0 08 1 ] fr*>\ SjIB:7W (LCDSItSSBI 
0) rt<D^SP4 3 2<Dffi6C, 0 1 1 (CS*TJ: 5 CCf=^ 
*;U#^ ICDbuMN. mtf«fl^3©«rffifc:<>£« 
.iB«a«5r*aci(Da^»4 3 3*«Wti«. 

A^cc^fi}f^^r*>*c<!:*^i6-t±r, mwiftft 

[0 082] 3c(c % ^mSj^JliJ^- Ffciior . mi5 
LfciB«CC»LrJi«1ftai*fT5«^©«fcffi«:Hl 2© 

10 [0 08 3] S 3 0 1 r, ^*IM£JftS5*:-- F** 

RJESti. S302r, »i^©i»mc<fc9->i> ?jr- 
**£>9 (UV-X) ^JfStlii, S3 0 3r*7SSU 
43 2CC^M«Hgr4E)*Ct*a^r4. C<Df£, 
S3 04r, Kfc*P8teT*. S305T, K:M£#**T 
S30 6m lftlB3hfc!Blfc*H«fcy*y 2. 
0 9&CiBtS3i±&o 

[0 084] ot^r k S 3 0 7 r tt. tll$iMigtt*s&£ 

fWr-r*.- f^HftCCjtUro&tttiK (S30 7(Dfl 
20 S^NO) , S2Q4tem~>xmfc<01bft*:1Bk*)&ir. 
BfS@»ecaWtiK ( S 3 0 7 ©aRUeaW Y E S ) . S3 
0 8m ^T^>^-rt<D**eB4 3 2CC^mHI«» 

[008 5] C<Df£, S 3 0 9 r, ^«^IJ®SP2 1 1 

ft4lr«ilf-><D|»*6fllW4 1 HfltftSftttti 
tf (S 3 0 9<D#85£#NO) , S3 10"C, 

2 0 9CC— B#Ktt3tl/c*r<DBI«CC*»7^ h^>* 

MiE^oim&mmzmx-. s 3 1 1 r, ^tcd®^® 
30 *y#- F8€caetts««. 

[0 08 6 ] «l^3»Brau&H«»*f»IBT?*ri*tt 
S6CC«jB«»tt5fiSSLrt^feO©iij«©-ii 

n^gs^ti^o, j*aiti'-*>ajRtf«ci*<oa«3&s«a£ 
uro^itdtt. ±»siJtaJSP2 1 namsci* 

tfcfiil <S3 0.9©#iJ5&WYES) . ^tfM0P8B2 1 1 

a*©*a^*-K<otea*—fiff±u, S3i 
mjf&b* 3 ltc^-r^o 

[0 08 7 ] 5fcff«C. S3 1 3t, Jli^CC*tLr, Jg 

40 SJL//c^r<DBi«%^r^, **o««^r*/cffii«<D 
«tS«b i o dcmmi- * o mi^^nj^^iMWT * <t , s 

3 1 0(Cji^. aJRl/ftiiHtRtCOiircD*^^ 

is*mjEm<Dmmm,*'u <x^~c. s 3 1 1 
3M^R^t^/c^a^^^ c e , ;^- F8cciBtg-r*o 

L < »* a ttmcc y * y * - f 8 (cEtt-r & ± 5 
urfe<to. 

[ 0 0 8 8 ] CCDJ: ^CC, ^KBft<Dft:dt>a)iSftft»m 
50 fcltl^*, BB«<0-feti3WSS£^rtifcO. HStti*> 
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